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DETAILED ACTION 

1 . This document is the first Office Action on the merits. This action is responsive 
to the following communications: The Non-Provisional Application, which was filed on 
December 11, 2003. 

2. Claims 1-33 have been examined, with claims 1,12, and 23 being the 
independent claims. 

3. The Drawings are objected to. 

4. Claims 1-33 are rejected. 

Information Disclosure Statement 

5. An initialed and dated copy of applicant's IDS form 1449, which was filed on 
December 1 1 , 2003, is attached to this Office Action. 

Drawings 

6. The drawings are objected to because the drawings elements are not clearly 
differentiated in that two drawing elements have the same names, both elements 318 
and 322 are identified as "structural element identifier." Con-ected drawing sheets in 
compliance with 37 CFR 1 .121(d) are required in reply to the Office action to avoid 
abandonment of the application. Any amended replacement drawing sheet should 
include all of the figures appearing on the immediate prior version of the sheet, even if 
only one figure is being amended. The figure or figure number of an amended drawing 
should not be labeled as "amended." If a drawing figure is to be canceled, the 
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appropriate figure must be removed from the replacement sheet, and where necessary, 
the remaining figures must be renumbered and appropriate changes made to the brief 
description of the several views of the drawings for consistency. Additional replacement 
sheets may be necessary to show the renumbering of the remaining figures. Each 
drawing sheet submitted after the filing date of an application must be labeled in the top 
margin as either "Replacement Sheet" or "New Sheet" pursuant to 37 CFR 1.121(d). If 
the changes are not accepted by the examiner, the applicant will be notified and 
informed of any required corrective action in the next Office action. The objection to the 
drawings will not be held in abeyance. 

Claims Rejections - 35 U.S.C. 102 

The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that 
form the basis for the rejections under this section made in this Office action: 
A person shall be entitled to a patent unless - 

(b) the invention was patented or described in a printed publication in this or a foreign country or in public 
use or on sale in this country, more than one year prior to the date of application for patent in the United 
states. 

7. Independent claims 1-4, 7-9, 12-15, 18-20, 23-26, and 29-31 are rejected under 
35 U.S.C. 102(b) as being clearly anticipated by Raman (U.S. Patent 5,748,186). issued 
May 5, 1998 [hereinafter "Raman"]. 

Regarding independent claim 1, Raman teaches: 

A method for creating a presentation document, the method comprising: 
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creating, in dependence upon an original document, a structured 

document comprising one or more structural elements; 
(See, Raman, col. 2, lines 18-35. See also, Raman, col. 3, lines 6-11, teaching a 
computer implemented system of interactively presenting electronically encoded multi- 
media information in a plurality of presentation modalities, including retrieving a 
document and converting the information to a "common intermediate representation" 
with a structure of the information.) 

classifying a structural element of the structured document according to a 

presentation attribute; and 
(As disclosed in the application, classifying a structural element reads on parsing a 
structured documents into a hierarchical tree based on markup language tags as nodes 
of the tree structure. See, Raman, col. 2, lines 27-28, reaching that the converted 
document is stored in the memory of a computer in the fomn of a hierarchical attribute 
tree. See, Raman, col. 3, lines 41-44, teaching recognizing file type by extension, i.e.: 
"html." See also, Raman, col. 5, lines 47 through col. 6, line 4, teaching identification of 
the document by tags, such as <html>. And see, Raman, col. 4, lines 38-49, teaching 
receiving a source document by characters encoded as text as well as marks placed in 
the text to define the structure, and the "recognizer" to parse the character stream into 
fundamental source elements, for example, title, sections, sub-sections, paragraphs, 
sentences, links, forms and so forth. See also, Raman, col. 5, lines 47 through col. 6, 
line 4, teaching identification of the document by text element tags, such as <head>, 
<title>, <body> and <P>.) 
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creating a presentation grammar for ttie structured document, wtierein ttie 
presentation grammar for ttie structured document includes grammar elements 
each of which includes an identifier for at least one structural element of the 
structured document. 

(See, Raman, col 2, lines 36-45, teaching the use of "control signals" as "presentation 
grammar" to control the modality being used to control the presentation. See, Raman, 
col. 6, lines 30-33, teaching that a control signal may include recognized speech as an 
input. See, also Raman, col. 3, lines 30-34, teaching that the data retriever and the 
presenter of the system may be controlled by voice recognized input couple to a speech 
recognizer. And see, Raman, col. 5, lines 38-46, teaching "navigational methods 
associated with objects allow the user to browse through the text by taking into 
consideration the underlying structure of the document." And see, Raman, claim 1 , 
lines 13-15, teaching "presenting the common intermediate representation using a 
plurality of user communication modalities according to the hierarchical attribute trees." 
And see, Raman, col. 4, lines 22-27, teaching speech response to aural presentation of 
stock data. For each type of speech response, it is inherent that there be an associated 
grammar.) 

Regarding dependent claim 2, Raman teaches: 

The method of claim 1 wherein classifying a structural element comprises: 
identifying a presentation attribute for the structural element; 
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identifying a classification identifier in dependence upon the presentation 
attribute; and 

inserting the classification identifier in association with the structural 
element in the structured document. 
(See, Raman, col. 4, lines 2-5, teaching tfiat the user may select the presentation style, 
which inherently includes inserting classification identifiers, tags, in the structured 
document.) 

Regarding dependent claim 3, Raman teaches: 
The method of claim 2 wherein: 

identifying a presentation attribute for the structural element includes 
selecting a presentation attribute from a list of supported presentation attributes; 

identifying a classification identifier includes identifying a classification 
identifier associated with the presentation attribute on the list; and 

inserting the classification identifier includes manually editing the 
structured document. 

(See, Raman, col. 4, lines 2-5, teaching that the user may select the presentation style, 
which inherently includes inserting classification identifiers, tags, in the structured 
document.) 

Regarding dependent claim 4, Raman teaches: 
The method of claim 2 wherein: 
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identifying a presentation attribute for the structural element includes 
selecting a presentation attribute from a list of supported presentation attributes, 
the presentation attribute having an associated classification identifier; 

identifying a classification identifier includes inserting the classification 
identifier in a data structure in association with a structural element identifier for 
the structural element; and 

inserting the classification identifier in the structured document includes 
reading the classification identifier from the data structure in dependence upon 
the structural element identifier. 
(See, Raman, col. 4, lines 2-5, teaching that the user may select the presentation style, 
which inherently includes inserting classification identifiers, tags, in the structured 
document.) 

Regarding dependent claim 7, Raman teaches: 

The method of claim 1 wherein creating a structured document further 

comprises inserting in the structured document structural element identifiers for 

the structural elements. 
(See, Raman, col. 4, lines 2-5, teaching that the user may select the presentation style, 
which inherently includes inserting classification identifiers, tags, in the structured 
document.) 

Regarding dependent claim 8, Raman teaches: 
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The method of claim 1 wherein creating a structured document further 
comprises converting existing structural element identifiers from the original 
document to structural element identifiers for the structural elements of the 
structured document. 
(See, Raman, col. 2, lines 18-34, and col. 3, line 6 through col. 4, line 76, teaching 
receiving original documents, e.g.: rendered in HTML, which is a structured document 
language, and parsing the data to a structured hierarchical attributed tree.) 

Regarding dependent claim 9, Raman teaches: 

The method of claim 1 wherein creating a presentation grammar for the 
structured document comprises: 

identifying the content type of the original document; 
(See, Raman, col. 5, lines 47-56, teaching retrieval, recognition, and presentation of an 
HTML document, as an example of the invention. See also, Raman, col. 3, lines 6-8, 
teaching a "recognizer 130" coupled to the receiver 120, to convert infonnation 1 1 into a 
common intermediate high-level logical data structure 200, the recognizer must 
inherently identify and know the content type of the original document in order to 
process it.) 

selecting, in dependence upon the content type, a full presentation 
grammar from among a multiplicity of full presentation grammars; and 
(See, Raman, col. 3, lines 8-20, teaching, for example, presentation of aural information 
by a speech synthesizer, monitor. Braille and by animated cartoon. See also, Raman, 
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col. 3, lines 30-34, teaching the use of a voice input speech recognizer to control the 
presenter of the content types.) 

filtering the full presentation grammar into a presentation grammar for the 

structured document in dependence upon the structural elements of the 

structured document. 
(It Is noted that filtering the full presentation grammar includes writing from the full 
presentation grammar to the presentation grammar for the structured document each 
grammar element having a structural element identifier of a structural element that 
occurs in the structured document. Applicants' disclosure, page 3 lines 23-26. 

See, Raman, col. 2, lines 36-45, teaching the use of "control signals" as 
"presentation grammar" to control the modality being used to control the presentation. 
See, Raman, col. 6, lines 30-33, teaching that a control signal may include recognized 
speech as an input. See, also Raman, col. 3, lines 30-34, teaching that the data 
retriever and the presenter of the system may be controlled by voice recognized input 
couple to a speech recognizer. And see, Raman, col. 5, lines 38-46, teaching 
"navigational methods associated with objects allow the user to browse through the text 
by taking into consideration the underlying stmcture of the document." And see, 
Raman, claim 1, lines 13-15, teaching "presenting the common intermediate 
representation using a plurality of user communication modalities according to the 
hierarchical attribute trees." And see, Raman, col. 4, lines 22-27, teaching speech 
response to aural presentation of stock data. For each type of speech response, it is 
inherent that there be an associated grammar.) 
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Regarding claims 12-15, claims 12-15, incorporate substantially similar subject matter 
as claimed In claims 1-4, respectively, and are rejected along the same rationale. 

Regarding claims 18-20, claims 18-20, incorporate substantially similar subject matter 
as claimed in claims 7-9, respectively, and are rejected along the same rationale. 

Regarding claims 23-28, claims 23-26, incorporate substantially similar subject matter 
as claimed In claims 1-4, respectively, and are rejected along the same rationale. 

Regarding claims 29-31, claims 29-31, incorporate substantially similar subject matter 
as claimed in claims 7-9, respectively, and are rejected along the same rationale. 

8. It is noted that any citations to specific, pages, columns, lines, or figures in the 
prior art references and any interpretation of the references should not be considered to 
be limiting in any way. A reference is relevant for all it contains and may be relied upon 
for all that it would have reasonably suggested to one having ordinary skill in the art. 
See. MPEP2123. 

Claims Rejection - 35 U.S.C. 103 

The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 
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(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 



9. Claims 5-6. 10-11, 16-17, 21-22, 27-28, and 32-33 are rejected under 35 
U.S.C. 103(a) as being unpatentable over Raman as applied to claim 1 above, and 
further in view of Josephson, (U.S. Patent Publication 2003/023435 A1). published 
January 30, 2003 [hereinafter "Josephson"]. 

Regarding dependent claim 5, Raman in view of Josephson teaches: 

The method of claim 2 further comprising providing a list of supported 
presentation attributes including at least one keyword and at least one indication 
of structural insertion scope for each presentation attribute, wherein: 

identifying a presentation attribute for the structural element includes 
selecting a presentation attribute from the list in dependence upon a keyword 
from the structured document; 

identifying a classification identifier includes identifying a classification 
identifier associated with the presentation attribute on the list; and 

inserting the classification identifier includes inserting the classification 
identifier in the structured document according to a structural insertion scope for 
the selected presentation attribute. 
(Raman teaches the creation of a structured document for user interaction based on 
attributes and classification, but it does not expressly teach a keyword and a scope. 
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Josephson expressly teaches the use of a keyword and scope within a 
"command structure, and lists within a "group." See, Josephson, paragraphs [0191]- 
[0259]. 

It would have been obvious to one of ordinary skill in the art at he time of the 
invention to combine the teachings of Raman and Josephson to result in a user 
interactive control of a structured document using a list of attributes, classifications 
(tags), and associated scope. 

Both Raman and Josephson are related to the art of user interactions with 
computers to control document production, including via voice recognition commands, 
and both use tag, or classification, structured documents. 

The suggestion or motivation for combining the references is found in 
Josephson, discussing the invention as an improvement to "voice-mousing" and control 
of "select next" type commands, which is one type of navigational control discussed in 
Raman. See, Josephson, paragraphs [0008]-[0010], and see, Raman, col. 7, lines 5- 
50.) 

Regarding dependent claim 6, Raman in view of Josephson teaches: 

The method of claim 2 further comprising providing a list of supported 
presentation attributes including at least one data pattern and at least one 
indication of structural insertion scope for each presentation attribute, wherein: 
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identifying a presentation attribute for the structural element includes 
selecting a presentation attribute from the list in dependence upon a data pattern 
from the structured document; 

identifying a classification identifier includes identifying a classification 
identifier associated with the presentation attribute on the list; and 

inserting the classification identifier includes inserting the classification 
identifier in the structured document according to a structural insertion scope for 
the selected presentation attribute. 
(Raman teaches the creation of a structured document for user interaction based on 
attributes and classification, but it does not expressly teach a keyword and a scope. 

Josephson expressly teaches the use of a keyword and scope within a 
"command structure, and lists within a "group." See, Josephson, paragraphs [0191]- 
[0259J. 

It would have been obvious to one of ordinary skill in the art at he time of the 
invention to combine the teachings of Raman and Josephson to result in a user 
interactive control of a structured document using a list of attributes, classifications 
(tags), and associated scope. 

Both Raman and Josephson are related to the art of user interactions with 
computers to control document production, including via voice recognition commands, 
and both use tag, or classification, structured documents. 
The suggestion or motivation for combining the references is found in Josephson, 
discussing the invention as an improvement to "voice-mousing" and control of "select 
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next" type commands, which is one type of navigational control discussed in Raman. 
See, Josephson, paragraphs [0008]-[0010], and see, Raman, col. 7, lines 5-50.) 

Regarding dependent claim 10, Raman in view of Josephson teaches: 

The method of claim 9 wherein the full grammar comprises a multiplicity of 
grammar elements for the content type, wherein each grammar element 
includes: 

an identifier of a structural element; 
a key phrase for invoking a presentation action; and 
a presentation action identifier representing a presentation action. 
(Raman teaches the creation of a structured document for user interaction based on 
attributes and classification, but it does not expressly teach a key phrase. 

Josephson expressly teaches the use of a key phrase for invoking a presentation 
action. See, Josephson, paragraphs [0191H0259]. 

It would have been obvious to one of ordinary skill in the art at he time of the 
invention to combine the teachings of Raman and Josephson to result in a user 
interactive control of a structured document using a list of attributes, classifications 
(tags), and associated scope. 

Both Raman and Josephson are related to the art of user interactions with 
computers to control document production, including via voice recognition commands, 
and both use tag, or classification, structured documents. 
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The suggestion or motivation for combining tlie references is found in Josephson, 
discussing tlie invention as an improvement to "voice-mousing" and control of "select 
next" type commands, which is one type of navigational control discussed in Raman. 
See, Josephson, paragraphs [0008H0010], and see, Raman, col. 7, lines 5-50.) 

Regarding dependent claim 11, Raman in view of Josephson teaches: 

The method of claim 9 wherein filtering the full presentation grammar 
comprises writing from the full presentation grammar to the presentation 
grammar for the structured document each grammar element having an identifier 
of a structural element that occurs in the structured document. 

(Raman teaches the creation of a structured document for user interaction based on 

attributes and classification, but it does not expressly teach writing from the full 

presentation grammar to the presentation grammar for the structured document. 
Josephson expressly teaches "groups" as collections of identifications for 

invoking a presentation action. See, Josephson, paragraphs [0191H0259]. 

It would have been obvious to one of ordinary skill in the art at he time of the 

invention to combine the teachings of Raman and Josephson to result in a user 

interactive control of a structured document using a list of attributes, classifications 

(tags), and associated scope. 

Both Raman and Josephson are related to the art of user interactions with 

computers to control document production, including via voice recognition commands, 

and both use tag, or classification, structured documents. 
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The suggestion or motivation for combining the references is found in Josephson, 
discussing the invention as an improvement to "voice-mousing" and control of "select 
nexf type commands, which is one type of navigational control discussed in Raman. 
See, Josephson, paragraphs [0008H0010], and see, Raman, col. 7, lines 5-50.) 

Regarding claims 16-17, claims 16-17, incorporate substantially similar subject matter 
as claimed in claims 5 and 6, respectively, and are rejected along the same rationale. 

Regarding claims 21-22, claims 21-22, incorporate substantially similar subject matter 
as claimed in claims 10-11, respectively, and are rejected along the same rationale. 

Regarding claims 27-28, claims 27-28, incorporate substantially similar subject matter 
as claimed in claims 5 and 6, respectively, and are rejected along the same rationale. 

Regarding claims 32-33, claims 32-33, incorporate substantially similar subject matter 
as claimed in claims 10-11, respectively, and are rejected along the same rationale. 

10. It is noted that any citations to specific, pages, columns, lines, or figures in the 
prior art references and any interpretation of the references should not be considered to 
be limiting in any way. A reference is relevant for all it contains and may be relied upon 
for all that It would have reasonably suggested to one having ordinary skill in the art. 
See. MPEP2123. 
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Conclusion 

1 1 . The following prior art is made of record and not relied upon that is considered 
pertinent to applicants' disclosure: 

Ladd, et al. (U.S. Patent 6,269,336 B1), teaching interactive markup language for 
interactive dialog betv^^een a person and a computer. 

Dantzig, et al. (U.S. Patent Application Publication 2003/0071833 Al), teaching 
using speech for input and output events with multi-modal applications, including Voice 
XML documents and browsers. 

Guerrra, etal. (U.S. Patent Application Publication 2002/0188451 Al), teaching a 
dynamically configured speech recognition portal. 

Ehsani, et al. (U.S. Patent Application Publication 2002/0032564 Al), teaching 
creation of phrase based grammar networks to control human-machine interaction. 

Huang (U.S. Patent Application Publication 2001/0032218 Al), teaching use of 
identifiers In the conversion of unstructured to structured documents. 

W3C, "XHTML+Volce Profile 1.0," December 21, 2001, pages 1-20, teaching 
markup language based visual and spoken Web based interactions. 

W3C, "Speech Synthesis Markup Language Version 1.," December 2, 2002, 
downloaded pages 1-36, teaching voice activated browser for Web access through 
spoken interaction. 

IBM, "IBM WebSphere Voice Server 2.0 Implementation Guide," IBM Redbook, 
May 2002, cover, copyright page, and pages 251-276 and 291-292. 
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Any inquiry concerning this communication or earlier communications from tlie 
examiner should be directed to Michael K. Botts whose telephone number is 571-272- 
5533. The examiner can normally be reached on Monday Thru Friday 8:00-4:00 EST. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Heather Herndon can be reached on 571-272-4136. The fax phone number 
for the organization where this application or proceeding is assigned is 571-273-8300. 

Infonnation regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). 



MKB/mkb 




